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An evaluation of the principal uncertainties in the computation of neutrino fluxes produced in 
cosmic ray showers in the atmosphere is presented. The neutrino flux predictions are needed for 
comparison with experiment to perform neutrino oscillation studies. The paper concentrates on the 
main limitations which are due to hadron production uncertainties. It also treats primary cosmic 
ray flux uncertainties, which are at a lower level. The absolute neutrino fluxes are found to have 
errors of around 15% in the neutrino energy region important for contained events underground. 
Large cancellations of these errors occur when ratios of fluxes are considered, in particular, the 
^ii/T^ii ratio below E^, — 1 GeV, the {v^ +77p)/(!/e +1/^) ratio below E^, — lOGeV and the up/down 
ratios above Ei, = 1 GeV are at the 1% level. A detailed breakdown of the origin of these errors and 
cancellations is presented. 

PACS numbers: 13.85.Tp, 14.60.Pq, 96.40.De, 96.40.Tv 
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I. INTRODUCTION 

The Super-Kamiokande collaboration have published 
detailed analyses [l|, of neutrino oscillation effects 
based on over 15,000 observed events induced by atmo- 
spheric neutrinos. Neutrino oscillations have also been 
observed in other measurements with atmospheric neu- 
trinos [1, 0, S [l] J accelerator neutrinos 0] , solar neutri- 
nos [1, Q and reactor neutrinos [l3| . A crucial part of the 
study of oscillation effects with atmospheric neutrinos is 
a detailed knowledge of the atmospheric neutrino beam 
at production, before oscillations occur. Increasingly so- 
phisticated calculations [ll|, IH, El, [11, [H, El, [l3 IH, 
[TqI . [20| have appeared recently. The uncertainties on the 
calculated flux become a limiting factor when one uses 
the atmospheric neutrino beam to search for sub-leading 
effects such as ^13 mixing, sub-maximal mixin g in the 
'atmospheric' sector or effects of solar mixing |2ll [2^ . 
This paper reports on a study to enumerate the uncer- 
tainties in the neutrino fluxes due to the major sources 
of uncertainty in the input to these calculations. 

The main features of the atmospheric neutrino fluxes 
can be understood from a discussion of their production 
mechanism as follows. Cosmic rays (about 80% of nu- 
cleons are free protons, the rest arrive bound in nuclei) 
collide with air molecules high in the atmosphere, gener- 
ating mesons which subsequently decay. The main pro- 
duction of neutrinos occurs in the decay of charged pi- 
ous —>■ /i+i^ and the subsequent decay of the muon 
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/i^ e^Vfj^Ve (and similar for antiparticles starting with 
TT^). Decay schemes involving kaons also contribute to 
the higher energy neutrino fluxes. From the main pro- 
duction mechanism, it is easy to see that at low energy 
where muons decay before hitting the earth, there should 
be roughly two muon type neutrinos for every electron 
type neutrino (this is quite a good rule of thumb, because 
the neutrino from the pion decay is similar in energy to 
the other neutrinos due to the heavy muon). 

In practice, neutrino fluxes are computed using Monte- 
Carlo simulation in which the development of the cosmic 
ray cascade is followed step-by-step for each track to in- 
clude details of bending in the Earth's magnetic field, 
of the density profile of the atmosphere and of parti- 
cle energy loss. The infiuence of the Earth's magnetic 
field on the primary cosmic ray flux is included using a 
particle back-tracking technique to evaluate the cutoffs 
(see e.g. [13l)- This affects mostly primaries up to about 
20 GeV. The primary cosmic ray flux in the same energy 
range is also modulated by the solar wind which varies 
with the 11-year solar cycle. 

The Earth's magnetic field causes the main depen- 
dence of the fiuxes on the location on the Earth, and 
also produces zenith and azimuth angle variation at each 
position. The zenith angle distribution is also affected 
by two other effects, (a) Higher energy muons hit the 
Earth's surface and stop before decay. This happens for 
vertical muons with energy above ~ 3 GeV which have a 
path length of about 20 km. Path lengths up to 500 km 
are possible for horizontal muons and so higher energy 
neutrinos from muon decay are present in the horizontal 
fiuxes. (b) The competition between meson decay and 
interaction occurs between 100 and 1000 GeV meson en- 
ergy, with higher energy particles preferring interaction 
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due to time dilation making decay less likely. Since more 
horizontal showers develop higher up, where the density 
is less, this crossover happens at higher energies than for 
vertical cosmic rays. 

A complication [l^ [2^ which is dealt with in modern 
Monte-Carlo calculations is the lateral spreading of the 
cosmic ray showers both from transverse momentum ac- 
quired in the interactions and decay of mesons and from 
bending of muons in the Earth's magnetic field. This 
makes the computation awkward as it requires generation 
of particles in all directions at all points on the Earth. 
The geomagnetic field is not symmetric enough to be use- 
ful for simplifying the problem. A speed up trick which 
can be used with care is to extend the size of the detector 
to cover an area extending ~ 500 km around the detec- 
tor [l^]- A much larger detector increases significantly 
the number of useful air showers. 

Early calculations [HI, [13 used a "1-dimensional" (ID) 
approximation in which the direction of decay and in- 
teraction products are adjusted to lie along the trajec- 
tory of the primary particle at its point of first colli- 
sion. In this approximation, bending of secondaries in 
the geomagnetic field is neglected. This allows the cal- 
culation to consider only trajectories that point directly 
at the detector, considerably reducing the computation 
time (by about a factor of 100 in the calculation in 
ref. [20|)- One effect of making the ID approximation 
is that a geometric enhancement of sub-GeV neutrino 
fluxes near the horizon [3, [13 is neglected. Charge-sign 
dependence of muon bending in the geomagnetic field 
produces differences between neutrinos and antineutri- 
nos up to ^ 100 GeV [23*1 which are absent in the ID 
approximation. Both effects are difficult to see with cur- 
rent detectors; the first because of the poor correlation 
at low energy between the direction of the neutrino and 
that of the charged lepton it produces, and the second 
because of the difficulty of measuring the charge of the 
neutrino-induced lepton. The geometric effect has been 
found to affect only neutrinos which contain little infor- 
mation about oscillations due to poor resolution of ei- 
ther neutrino direction (needed to reconstruct the path 
length) or energy; precisely the neutrinos which are ex- 
cluded from the analysis see e.g. [24| . 

The effects of uncertainties on absolute fluxes is fairly 
straightforward, a 10% change in hadron production or 
primary flux across the relevant regions of parameter 
space results in a 10% change in neutrino fluxes. The 
effects of uncertainties on various ratios of fluxes, such as 
up/down, or v^/ve^ is much less intuitive and also of con- 
siderable interest. The ratios are in principle much more 
stable against the uncertainties because any change af- 
fects the numerator and denominator in similar ways (e.g. 
in the v^j./ve ratio, both the Vp, and Ve flavoured neu- 
trinos are mainly produced in association with muons, 
therefore an increase in e.g. pion production will increase 
the muon flux by a similar amount which will increase 
both and fluxes by similar amounts). This cancel- 
lation is absolutely vital in extracting neutrino oscillation 



information from atmospheric neutrinos. Data analyses 
are constructed to take advantage of cancellation of un- 
certainties in the ratios. 

The main challenge in estimating the uncertainties in 
the computed unoscillated neutrino fluxes is to assign er- 
rors to the different measurements which are taken as 
input to the calculation. The dependence of the fluxes 
on the atmospheric density as a function of altitude, the 
details of muon energy loss in the atmosphere and the 
tracking in the Earth's magnetic field are found to be 
small ^25.] . The dominant sources of error are from un- 
certainties in hadron production and following this, un- 
certainties in the primary flux. We restrict ourselves to 
estimating errors from these two sources in this paper. 

The hadron production uncertainty is due to the large 
regions of parameter space (incident parent total energy 
Ei, secondary total energy Es (or equivalently, xiab, de- 
fined as Es/Ei), transverse momentum pr, target atomic 
weight A, projectile, secondary particle type) which are 
only sparsely populated by measurements from accelera- 
tors. Since measurements of production of neutrons and 
tt'^ are almost entirely absent, total energy conservation 
is not a strong constraint. 

This sparse population of hadron production phase 
space also makes it difficult to assign uncertainties on 
the value which has been used. We proceed with a prag- 
matic approach which is described in detail in section lTTTl 
to summarise, we select a given number of regions into 
which to divide the phase space and then assign inde- 
pendent errors to each based on the amount of existing 
accelerator data in that region. In quite a number of 
cases, this requires assigning an error to the procedure 
of extrapolation in px, a;iab, Ei or target nucleus. This 
assignment has been done by us and is somewhat subjec- 
tive. In all cases, it has been the intent to assign errors 
on the basis of the level of agreement between experi- 
mental measurements in a given region, or the amount 
of extrapolation into regions where measurements do not 
exist. The use of comparison between different models to 
assign errors has been avoided. The approach described 
in section IIVI has been used to address the correlation 
which exists between any mismeasurement in one region 
of phase space with the other regions. To establish that 
this method is reasonable, several variations have been 
tried and are presented in section IVIIII with a number of 
other crosschecks. 

Primary flux measurements are challenging because a 
variety of experimental techniques are required to cover 
the large energy region of interest between 1 GeV and 
lOTeV, the steeply falling flux as a function of energy 
makes calibration a critical issue and the experimen- 
tal apparatus needs to be operated in a hostile envi- 
ronment on a balloon or spacecraft. However, several 
high-precision measurements of the primary flux now ex- 
ist (26l [27l . l28t which resolve the historical discrepancy in 
the earlier data. These errors are included in the uncer- 
tainty estimate in a similar way to the hadron production 
as described in section fVl 
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Following this, section IVII discusses the uncertainties 
obtained on the absolute fluxes, the type-ratios v^/vei 
v^/V^, Ve/i^e and the directional ratios up/down and 
up/horizontal of both muon and electron type neutri- 
nos. Since most underground detectors are insensitive to 
lepton charge and therefore cannot distinguish neutrino 
and antineutrino, throughout this paper, the symbols t/^ 
and Vf, are used to refer to the sum of neutrino and an- 
tineutrino fluxes except when explicitly used alongside 
a symbol for antineutrino e.g. as in i^^/F^ or + il/^. 
The paper continues with section IVIII that classifies the 
uncertainties in the absolute fluxes and ratios according 
to which regions of hadron production phase space and 
primary flux are most responsible for the uncertainties. 
Various cross checks are presented in section I Villi and a 
limitation to the cancellation which is important when 
combining fluxes measured at different parts of the solar 
cycle into a ratio is shown in section IIXI Finally, con- 
cluding remarks are given in section 1x1 

II. PREVIOUS WORK 

Several previous estimates of uncertainties have been 
made. Agrawal et. al. [ll| have extracted error estimates 
of spectrum weighted moments, such as 

ZpT, = I J_ ^^P'" (a;iab)^da:iab. (1) 

These arise naturally from an analytic calculation which 
is possible if the flux can be approximated by a power 
law dependence which holds at high en- 

ergies. The authors compare spectrum weighted mo- 
ments obtained from data samples and from the hadron 
production models used in the calculation. They con- 
sider secondary pions and kaons and the ratio between 
pions and kaons, but do not consider how the uncer- 
tainty in tt^/tt" or K"'"/K^ affects the ratios. Battistoni 
et. al. [l^ describe in detail the methods by which the 
FLUKA Monte-Carlo hadron production generator oper- 
ates. The authors give many examples of cross checks be- 
tween FLUKA predictions and data measurements, such 
as predicting [sO] the measurements by AMS [1^ from 
320-390 km altitude of the backscattering of secondary 
particles from cosmic rays interacting in the atmosphere. 
They assign errors of ^ 10-15% on absolute fluxes and 
~ 2-5% on the flavour ratios. 

The Super-Kamiokande paper [l[ describes the issues 
involved in the flux uncertainties carefully and includes 
estimates of the uncertainties based on comparison of the 
different calculations which have been done. The paper 
also uses input on uncertainties from [Til . [Tsl . [l^ and the 
authors have made estimates of how much their unoscil- 
lated flux model is allowed to move. They assign errors 
on the ratio v^i/ve of ~ 3% for E,y < 5GeV, increasing 
to 10% at lOOGeV. Errors on v^/Vf^ and Ve/^e are 5% 
below lOGeV increasing to 25% and 10% above lOOGeV 
for and v^jv^^ respectively. Errors on the up/down 



ratio are around 1 to 2%. The absolute normalisation is a 
free parameter in the Super-Kamiokande oscillation fits 
reflecting that the uncertainties on the absolute fluxes 
could be large. 

Tserkovnyak et. al. [ij] have performed their calcula- 
tion with different hadron production generators for com- 
parison. 

The disadvantage of any technique which compares 
models as the sole method of estimating uncertainties is 
the possibility of disagreements having been tuned away 
as a correction to any previous comparison between the 
models; i.e. there is the possibility that all the models 
are wrong in the same way. 

It is possible to use the many measurements of muon 
fluxes as a validation of atmospheric neutrino flux predic- 
tions, a technique which is used by the authors discussed 
above and which gives a strong indication that the errors 
arc in the range which they quote. It must be noted how- 
ever that muon fluxes measured at a given altitude are 
much more sensitive than neutrino fluxes measured in un- 
derground detectors to uncertainties due to energy loss 
and atmospheric density. Muons observed at sea level 
are roughly 1% of all produced muons, while neutrino 
fluxes measure the total number of produced muons. The 
present work concentrates on propagating experimental 
uncertainties in hadron production and primary fluxes 
forward through the calculations of neutrino fluxes and 
does not use input from muon flux measurements. 



III. HADRON PRODUCTION UNCERTAINTIES 

The errors on the hadron production have been es- 
timated using only experimental measurements which 
were available for the hadron interaction models used 
by current atmospheric neutrino analyses [l|, [3, 0, H, @] . 
More extensive measurements covering a larger fraction 
of the phase space have recently become available from 
E910 [31], HARP [13 and NA49 [H,!!!]. Further mea- 
surements with carbon targets are expected soon from 
HARP and MIPP H. 

The assignment of uncertainties to the different parts 
of the parameter space has been done on the basis of the 
availability of data and the amount of extrapolation re- 
quired. This is described in detail in [2^. It has largely 
been done in a model independent way, but with a few 
guiding indicators. In particular, when the projectile en- 
ergy is in the region where resonances can be excited, the 
production cross section varies rapidly across parameter 
space and is difficult to extrapolate. At higher energies, 
the particle production varies more smoothly (Feynman 
scaling). 

Since only one neutrino from any given cosmic ray 
shower is ever detected, it is necessary to consider only 
single particle, inclusive hadron production as we track 
uncertainties through the calculation. We consider the 
reaction pN t:^X, where p is the projectile, N the 
target nucleus tt^ the particle of interest (a pion or kaon 
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usually) and X represents the rest of the interaction 
products. In most of the discussion of this paper, the 
projectile is a proton and the target is a hght nucleus 
such as beryllium, carbon or aluminium, which can be 
extrapolated to nitrogen and oxygen, which are the tar- 
gets in the atmospheric cascade. 

When a shower develops, the initial cosmic ray under- 
goes several interactions in which the initial energy is 
split among the branches of the shower. Tracing back- 
wards through the shower from the neutrino, through 
the ancestors to the original cosmic ray, one can define 
the branch along which any particular neutrino was pro- 
duced. At some point along the branch, there is a meson 
(tt^, or K°) which decays. The neutrino may be 
produced directly in this decay or via a muon. It is the 
distribution of energy, position on the globe and direc- 
tion of these mesons which govern the neutrino fluxes. 
This meson will be referred to as "the decay meson" . 

To simplify, we have limited the study of hadron pro- 
duction uncertainties to the interaction in which the first 
meson in the branch has been produced (i.e. its parent 
was a baryon). We now discuss two aspects which have 
been neglected in the uncertainties due to this simplifi- 
cation. (1) It is possible in the branch that the first me- 
son to be produced interacts and produces a subsequent 
string of hadrons before we reach the decay meson. This 
depends on the local atmospheric density and because 
of time dilation effects, is important only for higher en- 
ergy mesons (above ^ 200 GeV for pions and 600 GeV 
for kaons). The secondaries of such interactions will be 
lower in energy, a region populated by a large number of 
directly produced decay mesons from lower energy cos- 
mic rays, so the additional uncertainty because of such 
interactions is small. (2) The branch may contain a chain 
of interactions in which the initial cosmic ray baryon is 
converted into lower energy baryons before the decay me- 
son is produced. This could happen both by near-elastic 
scatters or in higher multiplicity interactions. Some of 
these daughter baryons are neutrons and very few hadron 
production measurements concerning either the produc- 
tion of neutrons or interactions with neutron projectiles 
are available. Therefore all aspects of neutrons in cosmic 
ray showers are obtained from isospin arguments from 
proton measurements. The uncertainty associated with 
this simplification (2) requires separate study. 

Figure [T] shows a map of the (_Ei, E^) phase space which 
is important for the production of neutrinos with energies 
appropriate to produce contained events in underground 
detectors and indicates the locations of hadron produc- 
tion experiments. 

Engel, et. al. [s^ summarize the extent to which these 
measurements cover the third dimension of phase space, 
transverse momentum pT- It is most important in at- 
mospheric neutrino interactions to understand the px- 
integrated yields. Yields at specific values of pt are less 
important since all px values are collected with the same 
probability in underground detectors (in contrast to ac- 
celerator beams where magnetic fields are used to focus 
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FIG. 1: (color online) Summary of measurements of single 
particle production yields as a function of primary energy 
and secondary energy. The bands for each experiment rep- 
resent the range of primary and secondary particle energies 
where measurements exist for at least one value of pt- The 
boxes on the plot show the contribution of the phase space 
to the generation of contained underground neutrino events 
as computed by the simulation. The red and black boxes in- 
dicate the extremes of geomagnetic field effects for high and 
low geomagnetic latitude respectively. 
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FIG. 2: Uncertainties assigned to the production rate of 
charged pions (left) and charged kaons (right) as a function 
of a;iab. The uncertainties are shown for various ranges of in- 
cident particle energy Ei for interactions of protons on light 
nuclei. 



specific regions of pt to form the beam) . Measurements 
over the whole px range are important to determine the 
integral. 

Most of the experiments report yields for both signs of 
charged pions and charged kaons. We discuss the uncer- 
tainties on charged pion yields first and then kaon yields. 
The uncertainties assigned are summarized in figure [2l 
There is a series of measurements with primary energies 
around 20 GeV [33, wS, ^91 with consistent measurements 
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spread over as much as 80% of the pr phase space [36| . 
allowing the hadron production to be determined with- 
out significant extrapolation. Above xiab of 0.6, this cov- 
erage reduces to around 50% requiring some extrapola- 
tion. There is only one experiment with measurements 
between xi^b of 0.1 and 0.2 and no measurements at all 
when a;iab is below 0.1. We have therefore assigned errors 
of 5% in the region 0.2 < xiah < 0.6, (somewhat below 
the errors quoted by a single experiment, to account for 
the good agreement between measurements) and have in- 
creased the errors to 10% for 0.1 < xuh < 0.2 and to 30% 
for xiab < 0.1 where extrapolation in xiab is necessary. 
Extrapolation to very low a;iab is challenging due to the 
uncertainty of how large the role of resonances is. Above 
a^iab = 0.6, an error of 10% is assigned due to the more 
limited coverage of [3?} in pj- for tt~ . This procedure is 
described in detail in ref. |25| . 

Errors also include a contribution due to extrapolation 
between targets. The best solid target is carbon which 
like the major components of the atmosphere contains 
equal numbers of neutrons and protons. Unfortunately, 
none of the measurements [13, S, [3§| used carbon, but 
did measure with Be, B4C and Al. 

The same procedure has been followed for Ei ranges 
below 8 GeV and between 8 and 15 GeV where measure- 
ments are available at intermediate a;iab ranges but ex- 
trapolation is required for xiab > 0.6. Extrapolation is 
also required for xiab < 0.2 in the £'i=8-15GcV range. 
Errors have been assigned assuming that it is not possi- 
ble to extrapolate between these different Ei ranges due 
to resonance effects. The range Ei > 30 GeV is where 
Feynman scaling is more effective and it is assumed that 
extrapolation in Ei is possible. The three most exten- 
sive measurements are Barton et. al. [iO] at 100 GeV 
(which includes a measurement with carbon), Atherton 
et. al. [4l[ at 400 GeV and measurements by the SPY 
collaboration [45] at 450 GeV. Above this, proton-proton 
measurements exist in limited regions of phase space from 
the ISR. A general 15% uncertainty has been assigned to 
the production rates in the region Ei > 30 GeV because 
some extrapolation is needed between the measurements 
and the pt coverage is limited from any one experiment. 
Since there are no measurements below xiab = 0.1 and 
resonance production in target fragmentation could be 
uncertain, the uncertainty is increased to 30% in this re- 
gion. To reflect the reliance on models to extrapolate 
to high energies, where experimental data from acceler- 
ators are unavailable, an energy dependent uncertainty 
u is added hnearly to the 15% (or 30% for xiab < 0.1) 
for interactions in which parents are above 500 GeV as 
follows. 

uiEi) = 12.2% X log,„ (^) (2) 

so u(lTeV)=4%, u(10TeV)=16% and m(100 TeV)=28%. 
u is not allowed to exceed 50% (which occurs at Ei = 
6PeV). 

The same procedure was used to assign uncertainties 



to kaons based on charged kaon production measure- 
ments. The uncertainties which are assigned are shown 
in figure (5] The kaon uncertainties are applied to both 
the charged and neutral kaons in the Monte Garlo cal- 
culation even though the level of K° and K produc- 
tion is determined through isospin relationships in the 
models. Many of the experiments which measure pion 
production also measure charged kaons, however below 
Ei = 15 GeV there are very few kaon production mea- 
surements and so larger uncertainties have been assigned 
in this region. The same value of u as described above 
was added hnearly to the 30% when Ei > 500 GeV (40% 
when xiab < 0.1). 

Although the role of the uncertainty of secondary nu- 
cleon production is not addressed in this study, it is worth 
noting that the uncertainties are especially large in the 
energy region around Ei = 20 GeV. Figure 15 of Ref. [i^ 
shows a comparison between data and various Monte 
Garlos; the data sets disagree and the models do not 
follow the data. 

The constraint imposed by overall energy conservation 
in the interaction may be used to limit the size of hadron 
production uncertainties provided the amount of energy 
carried away by neutral particles such as neutrons and 
7r° is estimated. The energy conservation constraint has 
not been used in the current study because it is intended 
that the individual hadron production error assignments 
used here can be scaled as future improvements in the 
measurements are made. 



IV. UNCERTAINTY REGIONS 

In order to carry out an analysis of the results of com- 
bining uncertainties in different regions of phase space, 
we want to define a set of uncorrelated sources of un- 
certainty that can be varied independently. Referring to 
figure [21 we assume that shifts within each region are 
fully correlated while completely neglecting correlations 
between adjacent regions. This is of course unrealistic, 
but we minimize the distortion of reality by choosing the 
boundaries so that as far as possible the different regions 
correspond to different physical effects. Thus for pions, 
Regions A, D and G contain the central region of phase 
space which relates primarily to multiplicity, while re- 
gions B, G, E, F and H represent the fragmentation region 
in which the pion production is determined mainly by the 
valence quarks. Regions C and B are more closely con- 
nected to each other, as are E and F, but we treat them 
separately in order to track which regions of phase space 
would most benefit from more precise measurements. 

For kaons, region W represents the very poorly mea- 
sured part of phase where resonance production is im- 
portant at low energy (below 15 GeV) and ss pair pro- 
duction in the central region is important at high energy. 
X and Y are used to represent associated production (a 
Aif-pair) at high energy. 

The energy dependent term in both pions and kaons at 



6 



Ei(GeV) 
<8 
8-15 
15-30 
30-500 
>500 



Pions 



Kaons 







A 


B 


D 


C 


E 


F 


G 


H 


H + l(Energy dep.) 



w 



Y+Z(Energy dep.) 







0.5 



1 



0.5 



FIG. 3: Uncertainty sources for hadron production. The un- 
certainties which are applied are fully correlated within each 
region shown and completely uncorrelated between regions. 
The letters used to label each region are used on subsequent 
figures. The levels of uncertainties applied are shown in fig- 
ure [1 



very high energies (equation ^) is varied independently, 
represented by the regions I and Z. 

The effect of changing the layout of these boundaries 
is found to have little effect on the uncertainty determi- 
nation; we defer a discussion of this to section IVfffI on 
cross checks. 

The approach chosen allows different regions of phase 
space shown in figure [3] in the (i?i,a;iab) plane to vary 
independently with the allowed la variation shown in 
figured] Since both the K/tt ratio and the K+/K~ ra- 
tio are nearly as poorly measured as the K production 
itself, the K"*" and K~ production are varied entirely in- 
dependently of each other and of the tt production. An 
uncertainty for the 7r+/7r^ ratio of ±5% has been applied. 
We assume that the interaction can be considered as a 
combination of centrally produced pairs of pions which 
do not contribute to an uncertainty in the charge ratio 
and a 20% contribution to the uncertainty from projec- 
tile fragmentation. This is obtained by assuming that the 
projectile may be excited into a state with given isospin 
which subsequently decays to a nucleon and a single pion 
and evaluating the different possibilities. 

The number of different uncertainty sources in our 
analysis is 18 in total (9 in pions, 4 in K~^, 4 in 
and 1 representing the 7r+/7r~ ratio), ft has been chosen 
to be roughly the same as the number of questions and 
worries in the model builder's minds. If the number of 
regions is too small (e.g. only 2 or 3), this describes a 
situation in which the shape of the hadron production 
is well defined, but the overall rate is unknown; in this 
case, the uncertainty cancels almost completely in the ra- 
tios of neutrino fluxes. If the number is too large (e.g. a 
few hundred) and all vary independently, this describes 
a situation in which there are large variations between 
local parts of the phase space and the uncertainties in 
adjacent regions average out and again underestimates 
the true uncertainty. 



V. PRIMARY FLUXES UNCERTAINTIES 

The primary flux uncertainties are incorporated into 
the uncertainties on the neutrino fluxes in a similar way 
to the hadron production uncertainties. Gaisser, Stanev, 
Honda and Lipari [3| (GSHL) have parameterized the 
primary fluxes as a function of energy in solar minimum 
conditions, based on a compilation of a large number 
of flux measurements. Measurements up to 200 GeV/n 
are possible using balloon or spacecraft mounted exper- 
iments. At higher energies, fluxes are determined by 
balloon borne emulsion-calorimeter techniques which are 
less precise. The GSHL parameterization gives the fluxes 
as follows 



(3) 



where Ep is the primary energy in GeV (in GeV/nucleon 
for nuclear cosmic rays) and d = 7 -I- 1 is the differential 
spectral index. The parameters a, b, c, and d are chosen 
separately for the proton fluxes and for the sum of all 
the nuclear fluxes. The parameter d governs the most 
striking feature of the cosmic ray fluxes; the extremely 
steep fall-off with energy. 

The uncertainties are obtained by estimating the vari- 
ation required in the parameters a to d to suitably cover 
the spread in the modern measurements. The values used 
are shown in table [J The uncertainty on the parameter 

TABLE I: Summary of primary fiux parameter variation 



Parameter 



Proton fluxes Nuclear fluxes 



a (normalization) 

b 

c 

d (index) < 200GeV/n 
> 200GeV/n 



1.49 ±0.10 
2.15 ±0.025 
-2.21 ±0.02 
2.74 ±0.01 
2.74 ±0.03 



0.060 ± 0.004 
1.25 ±0.03 

-0.14 ±0.02 
2.64 ±0.02 
2.64 ±0.04 



d is increased by a factor of three for primaries above 
200 GeV/n where the fluxes can not be measured with 
spectrometers. 

The proton flux measurements are compared on flg- 
ure m where the residual between the measurements 
and the above parameterization are plotted against cos- 
mic ray energy. Historically, there was a discrepancy 
among earlier measurements of up to 50% in the impor- 
tant region between 10 and 100 GeV. Modern experi- 
ments are in much better agreement although the data 
of CAPRICE g8|] is a little lower than AMS [261] and 
BESS [l^l which agree with each other very well. Analo- 
gously to the hadron production, the proton flux uncer- 
tainties are applied by using four uncertainty sources to 
allow the changes to the parameters a, 6, c, and d to be 
applied independently. 

The primary cosmic ray flux contains nucleons which 
are bound in nuclei of various sizes. For this estimate of 
the errors, we have assigned errors to the fluxes to cover 
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FIG. 4: (color online) Comparison of proton flux measure- 
ments to the GSHL parameterization with parameters given 
in Table |T] as a function of energy. The lines show the uncer- 
tainties on the fluxes used in this paper. 



FIG. 5: (color online) Comparison of helium flux measure- 
ments to the GSHL parameterization with parameters given 
in Table |I] as a function of energy per nucleon. The lines show 
the uncertainties on the fluxes used in this paper. 



the spread in helium fluxes as shown on figure [5] and used 
these errors as four more uncertainty sources to represent 
the variation for all nuclei other than protons. 



VI. ERROR ESTIMATES 

The flux calculation proceeds by performing a Monte- 
Carlo calculation with the same simulation program as 
in Ref. [l^l at 70 separate equally logarithmically-spaced 
energies between 1 GeV and 10 PeV and summing up the 
neutrinos which are produced; normalizing to the correct 
number of primary cosmic rays. To estimate the uncer- 
tainties, the calculation was repeated 26 times with each 
of the uncertainty sources described above (18 in hadron 
production and 8 in primary flux) individually adjusted 
by la to obtain the variation in neutrino flux as a func- 
tion of neutrino energy, type and zenith angle for each of 
the changes. The hadron production adjustment is per- 
formed by weighting the neutrinos where the first meson 
is produced with the values of Ei and xiab in the appro- 
priate ranges. The total uncertainty in the neutrino flux 
is obtained by adding the deviations in the 26 calculated 
fluxes in quadrature. Similarly, to determine the error on 
a given flux ratio, the ratio is recalculated for each of the 
26 changes and these deviations are added in quadrature. 

The ID approximation has been used to derive the 
error sensitivities presented in this paper. Although the 
ID approximation affects the values of the fluxes, it is 
not expected to change the sensitivity of the fluxes to 
the uncertainties considered here. 




FIG. 6: (color online) Fluxes, flux ratios and uncertainties for 
muon neutrino/antineutrinos plotted as a function of neutrino 
energy. The muon neutrino and antineutrino fluxes are shown 
by (red) circular points, the upper line is and the lower 
line is plotted against the scale on the right Eixis, the error 
bars represent the uncertainty from hadron production and 
primary fluxes. All of the following curves are plotted against 
the scale on the left axis. The uncertainties (in percent) in the 
fluxes are shown again with the (green) lines with no points 
for i/fi (lower line) and 77^ (upper line). The ratio of i/^ flux 
to Vfj, flux is plotted by the (blue) line with triangles and 
error bars indicating the estimated uncertainty in the ratio 
and the uncertainties in the ratio are shown in percent with 
the (black) line with square points. The large cancellation in 
the uncertainties in the ratio is apparent. 
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FIG. 7: (color online) Uncertainties in neutrino-type ratios as 
a function of neutrino energy. Vy^jV^ is shown with (black) 
lines with squares, v^lVc with (red) lines with circles and 
(yii -\'T'ti)l(y^ + Ve) with (green) lines with triangles. 



Figure [S] uses the muon neutrino to antineutrino flux 
ratio averaged over all zenith angles as an example to 
illustrate the level to which the cancellation in ratios oc- 
curs. The uncertainties on the fluxes are presented in 
two ways, firstly the fluxes are shown with error bars 
representing the uncertainties. Note how the neutrino 
flux falls steeply with energy in the same way that the 
primary fluxes do. This paper will concentrate on the un- 
certainties, for a more detailed description of the features 
of the fluxes themselves, see e.g. 

Figure [6] also shows the uncertainties plotted on their 
own (using the left scale), which is how they will be plot- 
ted in the later figures in this paper. They are around 
15% at energies corresponding to contained neutrino 
events which is consistent with previous studies pU. IT3|. 

In constructing the ratio of muon-neutrinos to muon- 
antineutrinos, the computation takes account of the can- 
cellation which occurs in the uncertainties, in this case 
because each muon in the atmosphere is associated with 
one neutrino and one antineutrino (all from the same 
parent pion) and so e.g. any overproduction of pions will 
tend to push both the numerator and denominator in 
the ratio upwards. The ratio of muon neutrino to an- 
tineutrino is shown on figure [6] (in blue) with downward 
triangle markers with error bars representing the uncer- 
tainty in the ratio. The uncertainty is also shown sep- 
arately (as later plots in the paper will be shown). A 
large cancellation is seen at low energies and the error on 
the ratio is well below 1% around — 200 MeV while 
the errors on the individual fluxes at this energy region 
is well above 10%, a cancellation of a factor of around 
50. At higher energies, this cancellation becomes rapidly 
less powerful as some of the muons hit the ground and 
so the pions only produce one neutrino. Above 100 GeV 
there is hardly any cancellation at all. 

Figure [7] presents the uncertainties on all three neu- 



trino type ratios averaged over all directions. The Vfi/v^ 
ratio is as shown on figure [6] The v^jvf, ratio does not 
show the same level of cancellation, since only a max- 
imum of one electron neutrino is produced from each 
pion. The uncertainty on (f^ -f F^)/(i'e + i^e) shows sim- 
ilar cancellation characteristics to v^/V^ since a single 
muon contributes to both the numerator and denomina- 
tor; the cancellation is large at low energies (where no 
muons hit the ground) because muons always produce 
neutrinos with both flavours (in the ratio 2:1). At higher 
energies, the ratio increases, but not as fast as v^/v^. 

Figure [5] gives the variation of the neutrino type un- 
certainties as a function of zenith angle for three dif- 
ferent neutrino energy ranges. At low energy, below 
E,y — 3 GeV, where the muons do not hit the sur- 
face, the uncertainty cancellation is good in all directions 
(figure [H^a)). As shown in figure [D^b), at intermediate 
energies, the uncertainty cancellation disappears more 
rapidly for vertical neutrinos than for horizontal ones as 
the vertical muons hit the ground with lower energies 
(path length ^ 20 km) than horizontal ones (path length 
^ 500 km). For neutrinos with energy above 30 GeV, 
the uncertainties on all three ratios are smaller by about 
a factor of two near the horizontal than near the verti- 
cal. The competition between interaction and decay of 
the mesons causes kaons to become more important at 
high energy. This occurs first near the vertical because 
the local atmospheric density where the cascade occurs 
is greater for vertical showers than horizontal ones. The 
large uncertainties in the ratios near the vertical reflect 
the relatively large uncertainties in kaon production. 

Cancellation of uncertainties also occurs in ratios 
of neutrinos from different directions. These are 
summarized in figure [9] which presents up/down and 
up/horizontal ratios for electron type and muon type 
neutrinos (in each case v + V). Since these represent 
neutrinos with (in principle) identical signatures in a de- 
tector but with different distances from the neutrino pro- 
duction site, these ratios are particularly useful for neu- 
trino oscillation studies. For this study, the directions are 
defined as follows: up is neutrinos with cos^z < —0.6, 
horizontal is neutrinos with |cos0z| < 0.3 and down is 
neutrinos with cos 6*2 > 0.6. The calculation has used 
the Kamioka detector site in Japan which is close to the 
geomagnetic equator (i.e. the low energy cosmic rays 
locally are suppressed compared to other points on the 
Earth). 

The uncertainty in the up/down ratio cancels exactly 
in the region Ei, > 4 GeV where the primary cosmic 
rays are above about 40 GeV and are too high in energy 
to be affected by the Earth's magnetic field. At these 
high energies, there is in principle no difference between 
any two locations on the Earth and from a geometrical 
argument, the upward neutrinos have the same zenith 
angle (but traveling downwards) at the location of their 
production as at the detector. When E^ < A GeV, the 
geomagnetic cutoffs cause the spectrum of primary cos- 
mic rays to be different for the up and the down neutri- 
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FIG. 8: (color online) Uncertainties in neutrino-type ratios 
as a function of zenith angle for (a) 0.3-3 GeV, (b)3-30 GeV 
and (c) above 30 GeV neutrino energy ranges. i^ij./T'^ is shown 
with (black) lines with squares, Ve/Ve with (red) lines with 
circles and (i^^+i^p) / (ve+T^e) with (green) lines with triangles. 



nos. Hence, different regions of hadron production phase 
space are selected and the cancellation in uncertainty is 
no longer exact. At low energies, the uncertainty in the 
up/down ratio is 7% in agreement with earlier esti- 
mates [ll. ITl|. The up/down uncertainties are the same 
for both muon and electron flavoured neutrinos. 
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FIG. 9: (color online) Uncertainties in directional ratios as a 
function of neutrino energy. 



Technically, in order to avoid statistical errors from 
the Monte-Carlo, it has been modified to generate neu- 
trinos (in the ID mode used in this calculation) in the 
downward direction and then to consider the neutrino as 
both downward and upwards by calculating the proba- 
bility that the primary could penetrate the geomagnetic 
field and interact in the atmosphere in the appropriate 
location and direction for both directions. This means 
that Monte-Carlo statistical error on the up/down ratio 
comes only from the neutrinos which pass the cutoff cal- 
culation in one direction but not the other. The curves 
shown agree well with calculations where this modifica- 
tion is not implemented except for statistical fluctuations 
in the uncertainty estimates when E^, is above 4 GeV. 

The up/horizontal uncertainty is also shown on fig- 
ure [HI Below Ev = ^ GeV, the features are caused by 
the same effect as the up/down ratio shown above. For 
> 4 GeV, the errors no longer cancel. This is be- 
cause of the different atmospheric density distribution 
as a function of slant depth which causes more meson 
reinteraction (rather than decay) for vertical cosmic rays 
than for horizontal ones. A pion which doesn't interact 
has a chance to produce a high energy neutrino, whereas 
one which interacts will produce a neutrino in a lower 
energy bin where there are many neutrinos from lower 
energy cosmic rays. Therefore the up/horizontal ratio 
at high energies is uncertain because meson reinteraction 
causes different regions of phase space to be emphasized. 



VII. CONTRIBUTIONS TO THE 
UNCERTAINTY 

The technique allows the contributions from the indi- 
vidual uncertainties which have been inserted to be com- 
pared. It is interesting to identify which uncertainties 
have the largest effect on any given quantity. These are 
shown in figures [TUl to [T51 The lines on all these plots are 
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FIG. 10: (color online) Breakdown of flux uncertainties 
(shown here for angle averaged muon neutrinos) with different 
regions of hadron production as a function of neutrino energy. 
The capital letters in the key correspond with the hadron pro- 
duction uncertainty zones in figure|3]and the one labeled 'Chg' 
represents the pion charge ratio uncertainty. The lower case 
letters in the key correspond to variation of the flux parame- 
ters in table (H]). See text for more information. The topmost 
thick (black) line with no points is the total error on the flux 
and the lower line of the same style is the total hadronic error 
(i.e. excluding the uncertainty from the primary flux). 



the same and are described in the caption to figure [TOl 
The green lines with symbols which are either solid or 
with the line going through them (A - I) are the pion 
uncertainties. The purple line with crosses (Chg) is the 
line representing the pion charge ratio uncertainty (for 
all phase space regions). The blue lines with symbols 
which over-stamp the line (W - Z) are the uncertainties 
from kaons. Each of the four lines W - Z represents the 
combination (quadrature sum) of two independent un- 
certainties for positive and negative kaons. The phase 
space regions corresponding to all these lines is summa- 
rized in figures [2] and [3l The red lines with quartered 
circle symbols (a - d) correspond to the uncertainties on 
the primary flux parameters {a - d) as given in table U 
Each line is the combination of the proton and all-nuclei 
contribution to the uncertainty. 

Figure [10] shows the breakdown of uncertainties for the 
muon neutrino flux (angle averaged) . No single source of 
error dominates. Above 1 GeV the primary flux uncer- 
tainty (in particular the value of the spectral index d) is 
important. The pion hadron production regions D, G, H 
and I are important at respectively higher neutrino ener- 
gies. The kaon uncertainties are not an important effect 
except at the very highest energies. 
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FIG. 11: (color online) Breakdown of uncertainties in flavour 
ratios with different regions of hadron production, shown as 
a function of neutrino energy, (a) (//p +T'fi)/(i'e +T'e) ratio 
(b) I'^/Vfi ratio and (c) v^/V^. Key as in figure [TOl 
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FIG. 12: (color online) Breakdown of uncertainties in 
up/down ratio for muon neutrinos, shown as a function of 
neutrino energy, key as in figure (TO] 



FIG. 13: (color online) Breakdown of uncertainties in 
up/horizontal ratio, key as in figure (TO] 



The three parts of figure [TT] show the breakdown in 
uncertainties of the angle averaged neutrino type ratios. 
The level of cancellation is different for the different er- 
ror contributions and different for each of the three ra- 
tios. In no case does the primary flux contribution play 
a major role. The (f^ -|-I7^)/(i/e +T'e) ratio shown in 
figure fTlTa) is mostly affected by the pion production at 
low energy. There are Monte-Carlo statistical effects in 
the uncertainties below about 0.3%. Figure fTTT b) shows 
the Vfi/Vf^ ratio which shows that the main uncertainties 
are caused by kaon production. We have perhaps been a 
bit pessimistic in assigning completely separate errors to 
K"*" and K~ production, however this reflects the different 
nature of the production of AK"*" and K+K" pairs. The 
breakdown in Ve/ve uncertainties is shown in figurc fTlT c). 
Since only one electron type neutrino is produced for each 
pion and whether it is a neutrino or antineutrino is al- 
most completely defined by the sign of the pion, this error 
is dominated by the pion charge ratio error assignment. 
We inserted an error on tt^/tt" of 5% and the error on 
Ve/i'e is essentially 5%. At higher energy [E > 10 GeV), 
kaon production begins to dominate the error budget as 
the Ke3 decay becomes the principal source of electron 
neutrinos. 

Similarly figure \\% shows the breakdown in up/down 
ratio uncertainties for muon type neutrinos. The break- 
down of the errors in up/down ratios for electron neu- 
trinos is almost identical. The largest source of errors 
comes from hadron uncertainty source D followed by A; 
i.e. the hadron production regions at low xlab- The 
recent hadron production measurements cover this re- 
gion, so the precision to which this ratio can be predicted 
should improve. 

Figure [T3] shows the up/horizontal flux ratio uncer- 
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FIG. 14: (color online) Stability of the uncertainty estimates 
as a function of different choices of uncertainty sources ((1), 
(2), (3)), detector location (Soudan) and base hadron produc- 
tion generator. 



tainty breakdown for muon type neutrinos. At low ener- 
gies, the contributions arc similar to the up/down ratios. 
At high energies, all the uncertainty sources G, H, I, W, 
Y and Z representing the uncertainties in hadron pro- 
duction with high energy parent particles are present, 
indicating that the different slant depth has caused a re- 
duction in the cancellation of uncertainties. 

The breakdown for electron type neutrinos in the 
up/horizontal ratio is similar with somewhat higher con- 
tributions from each of the hadron production uncer- 
tainty sources as shown on flgurelHl 



12 



E, (GeV) 
<8 ' 
8-15 
15-30 
30-500 
>500 



Pions 



Kaons 



01 


02 


1 03 1 


04 




01 


02 


1 03 1 


04 


05 


06 


07 


08 


09 


10 




05 


06 


07 


08 


09 


10 


11 


12 


13 


14 


15 


16 




11 


12 


13 


14 


15 


16 


17 


18 


19 


20 


21 


22 




17 


18 


19 


20 


21 


22 


23 


24 + 25(Energy dep.) 




23 


24 + 25(Energy dep.) 

1 1 1 1 1 1 1 







0.5 



1 



0.5 



FIG. 15: Uncertainty sources used in the alternative 2 hadron 
production weighting scheme. The sources 01-25 allow more 
independence to different values of a;iab than the standard 
scheme and have full correlation between pions and kaons in 
the same region of (i?i,a;iab). 
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FIG. 16: Uncertainty sources used in the alternative 3 hadron 
production weighting scheme. The sources 01-23 allow more 
independence to different values of Ei than the standard 
scheme and have full correlation between pions and kaons in 
the same region of (iJijXiab). 



VIII. CROSS CHECKS 

To check the stability of the uncertainty estimates pre- 
sented in this paper, they were recalculated a number 
of times to quantify the effects of modifications. First, 
the layout of the uncertainty sources within the hadron 
production phase space was changed in three different 
ways. The effect on the I'p^/i'e ratio is shown in fig- 
ure [Ml In all three cases, the size of the uncertainties 
themselves were maintained the same as in the standard 
calculation as shown on figure ^ Alternative 1 divides 
up the phase space in the same way as the standard un- 
certainty sources shown on figure [3] but to reflect that 
the uncertainties in the measurements are also present 
in the regions where they are extrapolated, each region 
of (£'i,a;iab) is influenced by up to two separate sources 
added in quadrature, the flrst is at the level of a region 
where measurements are made and the second reflects 
the additional error we added to account for extrapola- 
tion. For example, the region 8GeV< Ei <15GeV and 
a^iab <0.2 is comprised of an uncertainty source with 10% 
uncertainty reflecting the measurement error and 28% 
due to extrapolation leading to a total error of 30%. 

Alternative 2 rearranges the uncertainty sources to be 
more finely divided in cciab and uses the same uncertainty 
sources for pions and kaons. It is shown in figure 1151 
Similarly, alternative 3, shown in figure [TBI divides phase 
space more finely in Ei. All three schemes include the 
uncertainty sources for the primary fiuxes and the tt'^ /Tr~ 
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FIG. 17: (color online) Increase in muon neutrino to electron 
neutrino flux uncertainty when comparing fluxes from differ- 
ent parts of the solar cycle at Soudan. 



ratio. Alternative 1 handles the K+/K^ in a similar way 
to the standard method and alternatives 2 and 3 include 
the K^/K" ratio uncertainty with a single source. As 
seen on figure [HI the uncertainty on the v^/ve ratio is 
independent of which scheme is used. This is also true in 
general for the other ratios. 

Figure [141 also shows two other cross-checks which do 
not significantly affect the error estimation. The uncer- 
tainty analysis was run with a different detector location, 
at Soudan in North America near one of the geomagnetic 
poles. 

Since the analysis operates by applying weights to dif- 
ferent regions of phase space it could give misleading re- 
sults if, for example, part of the phase space is not used 
at all by the hadron production generator. We therefore 
repeated the analysis using the hadron production gen- 
erator from the HKKM04 calculation [l^] to verify that 
the same results were obtained as shown on figure [TH 

A further cross check was to perform the combination 
of errors from different hadron production regions us- 
ing a statistical method. The standard method moves 
each uncertainty source by la, computes the movement 
of each ratio and adds the effects of each uncertainty 
source in quadrature. The statistical method performs 
500 calculations each with randomly assigned uncertain- 
ties to all the uncertainty sources. The error on the fluxes 
and ratios was then determined from the widths of the 
distribution of the 500 different results. This method is 
equivalent and gave identical results within the limits of 
Monte-Carlo statistical fluctuations. 



IX. SOLAR WIND 

As seen in the distributions above, the uncertainties 
in flux ratios can be reduced signiflcantly by cancella- 
tions. So far, all ratios shown assume that the ratios 
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which are formed are taken simultaneously, i.e. no un- 
certainty is added if the two components of a ratio were 
taken at different times in the solar cycle where the so- 
lar wind changes the primary spectrum below cosmic ray 
energies of ~ 10 GcV. The MINOS experiment IGl] is sit- 
uated in the Soudan iron mine in Northern Minnesota, 
USA at the same location as the Soudan-2 experiment. 
Ref. which studies muon flavoured neutrinos uses v^. 
data from ref. Q to normalize the unoscillated fluxes 
from the Monte-Carlo calculation . Since the Soudan- 
2 data and the MINOS data are taken at different parts 
of the solar-cycle, the large cancellation in the Vp^/Vf, ra- 
tio shown in figure [7] is not so exact. Figure [TTI compares 
the uncertainty on the Vfj./ve ratio between the standard 
calculation and one in which the is taken at solar mini- 
mum conditions and the Ve at solar maximum conditions. 
The uncertainty cancellation is not so good and is about 
2.5% averaged over the energy region appropriate for the 
MINOS data sample. 
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FIG. 18; (color online) Line with open squares shows the 
standard uncertainty in the up/horizontal v^^ flux ratio and 
line with closed circles the uncertainty with the efltect of the 
Earth's magnetic field removed. 



X. CONCLUSIONS 

A detailed survey of the main uncertainties involved in 
the computation of the production of neutrinos in the at- 
mosphere has been presented. The major contributions 
which come from hadron production and the primary 
fluxes have been addressed. Regions where uncertainties 
exist and the amount of uncertainty in each region have 
been assigned based on the data which exists and not 
on any agreement or otherwise between different models 
(which may have been initially tuned on the same data or 
compared and adjusted to enhance agreement). An at- 
tempt to account for correlations of uncertainties across 
hadron production phase space has been employed and 
variants tested showing that the main conclusions of this 
paper do not depend on the particular scheme used. 

The uncertainties on the fluxes are around 15% in 
agreement with previous evaluations. There is consid- 
erable cancellation of uncertainty when taking ratios of 
fluxes, either from different directions or of different neu- 
trino types. These are of similar size to previous esti- 
mates [ij, llll [l3] , but arc found to vary considerably with 
neutrino energy. 

The breakdown of the uncertainties reveals that there 
is no single hadronic source of uncertainty which dom- 
inates. The production of pions at low energy which is 
currently being measured by several modern experiments 
is most important in the up/down and up/horizontal ra- 
tios for contained neutrinos. The knowledge of kaon pro- 
duction is important even for neutrinos as low as 4 GeV, 
particularly in the muon neutrino to antineutrino ratio. 

As described in the paper, the method of assigning 
and applying the hadron production uncertainties to this 
problem is not unique or complete. One major omission 
with this method is that we have only included uncer- 
tainty at one point along the path to production of the 
neutrino, namely, at the production of the first mesonic 



ancestor of the neutrino. Another potential source of un- 
certainty is in the baryonic part of the shower. A primary 
proton may undergo several soft elastic or near elastic 
collisions, on it's journey to the collision where the de- 
cay meson is produced. Low energy proton production is 
especially badly measured and models disagree consider- 
ably (43j . In addition, data on neutron production and 
also on interactions with neutron parents are very scarce. 

The large degree of cancellation in the flux ratios, in 
particular seen in the primary fluxes gives us encourage- 
ment that these baryonic shower uncertainties are not 
going to be a major effect. Since they occur upstream of 
the hadron uncertainties we consider, they could be rep- 
resented as an increase in flux uncertainty by redefining 
'flux' to mean the spectrum of the baryons at the point 
of production of the first-meson. 

The cancellations in uncertainties in flux ratios are a 
central part of any analysis of neutrino oscillation using 
cosmic rays. This study shows the details of this cancel- 
lation as a function of neutrino energy and for the first 
time identifies the sources of the uncertainties which re- 
main. There are two major effects which are identified 
in the direction ratios which cause the cancellation to be 
incomplete. 

The first effect is observed when the numerator and de- 
nominator of the ratio originate from cosmic rays which 
have different geomagnetic effects. This causes some re- 
gions of hadron production phase space to be only in- 
cluded in either the numerator or the denominator, so 
the uncertainty of that part of hadron production phase 
space does not cancel. This is apparent in the up/down 
ratio at low energy shown on figure [51 At high energy, 
where the cosmic rays are not removed by the geomag- 
netic field, the cancellation in the up/down ratio is exact. 

The second effect is that if the slant depth in the 
atmosphere is different for the numerator and denom- 
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inator (e.g. the up/horizontal ratio, but this apphes 
to comparing any two different general zenith angle di- 
rections), then the balance between meson decay and 
interaction is different and cancellation is incomplete. 
This is illustrated on figure [TSl which compares the usual 
up/horizontal uncertainty with one where all geomag- 
netic field effects have been removed. At low energy, the 
uncertainty is zero since all directions are now equivalent, 
but at higher energy, the uncertainty is as large as in the 
full uncertainty calculation. 
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